Comparison Algorithm for Diabetes Classification with Consideration of Mutual Information and Information Feature
نویسندگان
چکیده
Diabetes is a prevalent disease in humans that caused by excessive sugar levels the body. If left untreated, it can lead to severe consequences such as paralysis, decay certain parts of body, and even death. Unfortunately, early detection diabetes difficult, many cases go untreated until too late. However, development technology has opened up new possibilities for treatment diabetes. One approach classification, commonly used method field Computer Science. Classification various fields, including health, agriculture, animal diseases, draw conclusions based on input data using cause-and-effect relationships. Many different learning concepts methods be with Decision Tree concept being one most popular examples. This study compares several classification methods, Tree, Random Forest, AdaBoost, Stochastic Gradient Boost, feature selections carried out MI IF. The aims evaluate effectiveness these influence selection improving their performance. Based results study, concluded Mutual Information Importance Feature improve accuracy some particularly Boost. algorithm did not show any improvement after selection. best was achieved Boost original dataset without selection, while Forest showed highest all features. Overall, suggest useful technique performance algorithms prediction. suggests future research could investigate other Neural Network or Deep Learning, use optimization like Genetic Algorithm Particle Swarm Optimization results.
منابع مشابه
On Classification of Bivariate Distributions Based on Mutual Information
Among all measures of independence between random variables, mutual information is the only one that is based on information theory. Mutual information takes into account of all kinds of dependencies between variables, i.e., both the linear and non-linear dependencies. In this paper we have classified some well-known bivariate distributions into two classes of distributions based on their mutua...
متن کاملResearch of Blind Signals Separation with Genetic Algorithm and Particle Swarm Optimization Based on Mutual Information
Blind source separation technique separates mixed signals blindly without any information on the mixing system. In this paper, we have used two evolutionary algorithms, namely, genetic algorithm and particle swarm optimization for blind source separation. In these techniques a novel fitness function that is based on the mutual information and high order statistics is proposed. In order to evalu...
متن کاملResearch of Blind Signals Separation with Genetic Algorithm and Particle Swarm Optimization Based on Mutual Information
Blind source separation technique separates mixed signals blindly without any information on the mixing system. In this paper, we have used two evolutionary algorithms, namely, genetic algorithm and particle swarm optimization for blind source separation. In these techniques a novel fitness function that is based on the mutual information and high order statistics is proposed. In order to evalu...
متن کاملFeature Scoring by Mutual Information for Classification of Mass Spectra
Selecting relevant features in mass spectra analysis is important both for classification and search for causality. In this paper, it is shown how using mutual information can help answering to both objectives, in a model-free nonlinear way. A combination of ranking and forward selection makes it possible to select several feature groups that may lead to similar classification performances, but...
متن کاملMutual information-based feature selection for multilabel classification
This paper introduces a new methodology to perform feature selection in multi-label classification problems. Unlike previous works based on the χ2 statistics, the proposed approach uses the multivariate mutual information criterion combined with a problem transformation and a pruning strategy. This allows us to consider the possible dependencies between the class labels and between the features...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Jurnal komputasi
سال: 2023
ISSN: ['2541-0296', '2541-0350']
DOI: https://doi.org/10.23960/komputasi.v11i1.6649